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(54) Road modeling method for lane drifting warning system 



(57) Disclosed is a road modeling method for a lane 
drifting system. The method includes the steps of ex- 
tracting an edge of lane markers of a lane in which a 
vehicle is being driven by a camera collecting images of 
the lane markers and outputting corresponding image 
signals, removing noise from the lane marker image sig- 
nals, and dividing the image signals into multiple reso- 
lutions; performing road modeling by inputting a mini- 
mum number of possible marking points of lane edges, 
and extracting two straight lines most closely defining 



the lane by using the least squares method on the 
points, then determining if the road modeling is complet- 
ed; calculating a width of the lane if the road modeling 
is completed by calculating a camera parameter accord- 
ing to a positioning of the camera, and by determining 
a distance between pixels of image coordinates; and de- 
termining if the vehicle is veering from the lane using 
information of the width of the lane, and outputting a 
warning if it is determined that trie vehicle is veering from 
the lane. 
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Description 

BACKGROUND OF THE INVENTION 
5 (a) Field of the Invention 

[0001] The present invention relates to a road modeling method for a lane drifting warning system, and more partic- 
ularly to a method for a lane drifting warning system in which a road can be precisely modeled while a vehicle is being 
driven, even with the generation of errors caused by noise in road image signal data 

10 

(b) Description of the Related Art 

[0002] A conventional lane drifting warning system, with reference to FIG. 1 , comprises a camera, such as a con- 
catenated disk (CCD) camera for collecting images of lane markers and outputting corresponding image signals; an 
15 electronic control unit (ECU) for receiving the image signals output from the camera, processing the image signals 
using a pre-installed program to determine if the vehicle is veering from the lane it is in, and outputting alarm signals 
if it is determined that the vehicle is drifting out of the lane; and an alarm unit for outputting an alarm to alert the driver 
if the alarm signals are output from the ECU. 

[0003] In such a conventional lane drifting warning system, road modeling is performed using the image signals and 
20 the program that is pre-installed in the ECU to determine if the vehicle is drifting out of the lane. The road modeling, 
with reference to FIG. 2a, is performed by extracting and selecting a plurality of points that are determined to be possible 
indications of road lane markers, then connecting the points by a straight line. 

[0004] However, if noise is generated in the image signal data as a result of various external forces (e.g., radio wave 
interference, physical shocks given to the system, defective parts and operation of the system), road modeling errors 
25 can occur such that the lane marker modeling is distorted as shown in FIG. 2b. Accordingly, two serious outcomes 
may result: not warning the driver when the vehicle is veering from the lane, and erroneously outputting an alarm when 
the vehicle has not drifted out of the lane. 

[0005] Further, complicated hardware is required to extract the points that are determined to be possible indications 
of road lane markers as described above. Finally, the process of extracting such points is inherently slow, making real- 
30 time operation difficult. This can lead to alerting the driver in an untimely manner. 

SUMMARY OF THE INVENTION 

[0006] The present invention has been made in an effort to solve the above problems. 
35 [0007] It is an object of the present invention to provide a road modeling method for a lane drifting warning system 
in which after an edge of lane markers is extracted, road modeling is precisely performed even with the generation of 
errors as a result of noise in extracted lane marker data. 

[0008] To achieve the above object, the present invention provides a road modeling method for a lane drifting warning 
system. The method includes the steps of extracting an edge of lane markers of a lane in which a vehicle is being 

to driven by a camera collecting images of the lane markers and outputting corresponding image signals, removing noise 
from the lane marker image signals, and dividing the image signals into multiple resolutions; performing road modeling 
by inputting a minimum number of possible marking points of lane edges, and extracting two straight lines most closely 
defining the lane by using the least squares method on the points, then determining if the road modeling is completed; 
calculating a width of the lane if the road modeling is completed by calculating a camera parameter according to a 

'5 positioning of the camera, and by determining a distance between pixels of image coordinates; and determining if the 
vehicle is veering from the lane using information of the width of the lane, and outputting a warning if it is determined 
that the vehicle is veering from the lane. 

[0009] According to a feature of the present invenlion, the step of performing road modeling further includes the 
steps of inputting a minimum number of the possible marking points of the extracted lane edges; obtaining a linear 
>o function having a minimum deviation from the possible marking points of the lane edges; and obtaining lines of the 
lane markings defining the lane using the linear function. 

BRIEF DESCRIPTION OF THE DRAWINGS 

; 5 [0010] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate an 
embodiment of the invention, and, together with the description, serve to explain the principles of the invention: 



FIG. 1 is a block diagram of a conventional lane drifting warning system for vehicles; 
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FIG. 2a is a drawing used to illustrate modeling of lane markers in the conventional lane drifting warning system 
of F4G. 1; 

FIG. 2b is a drawing used to illustrate modeling of lane markers in the conventional lane drifting warning system 
of FIG. 1, in which noise is generated in image signal data; 
s FIG. 3 is a flow chart of a road modeling method for a lane drifting warning system according to a preferred em- 

bodiment of the present invention; 

FIG. 4 is a flow chart used to describe in more detail the road modeling method according to a preferred embodiment 
of the present invention; and 

FIG. 5 is a graph used to illustrate road modeling using the least squares method according to a preferred em- 
w bodiment of the present invention. 



DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 



[0011] Preferred embodiments of the present invention will now be described in detail with reference to the accom- 
1$ panying drawings. 

[0012] FIG. 3 is a flow chart of a road modeling method for a lane drifting warning system according to a preferred 
embodiment of the present invention. 

[0013] First, in step S20, a camera collects images of lane markers of a lane in which the vehicle is being driven, 
then the images are converted into image signals and output. Next, noise is removed from the lane marker images in 
20 step S21 , after which the images are divided into multiple resolutions in step S22. Subsequently, while maintaining the 
multiple resolutions, lane marker edges are quickly extracted in step S23. After the lane marker edges are extracted 
in step S23, road modeling is performed in step S24. That is, a minimum number of possible markings of lane edges 
are input, then a straight line most closely following the markings is extracted by using the least squares method (i.e., 
■the least squares fit"). 

2S [0014] Next, it is determined if the road modeling process is completed in step S25. If the road modeling is not 
completed in step S25, the process returns to step S23. However, if the road modeling is completed in step S25, a 
camera parameter according to a positioning of the camera is calculated, and a width of the lane according to a distance 
between pixels of image coordinates is determined in step S26. After this step, it is determined if the vehicle is veering 
from the lane in step S27. If the vehicle is not veering from the lane in step S27, the process returns to step S23. 

30 However, if the vehicle is drifting out of the lane in step S27, a warning is output to alert the driver in step S28. 

[0015] FIG. 4 is a flow chart used to describe in more detail the road modeling method according to a preferred 
embodiment of the present invention. First, a minimum number of possible markings of the extracted lane edges are 
input in step S40. Next, a linear function having a minimum deviation is obtained from the possible markings of the 
lane edges by using the least squares method in step S41. Following this step, lines defining the lane markings are 

35 obtained using the linear function in step S42, thereby completing the road modeling process. 

[0016] FIG. 5 is a graph used to illustrate road modeling using the least squares method according to a preferred 
embodiment of the present invention. As shown in the drawing, a compromise line fit ol the line marking data is obtained 
using the least squares method, or "least squares fit". That is, after a plurality of possible points for the lane markers 
are obtained, the least squares method is used to find a compromise line that follows the flow of the points. 

to [0017] The operation of the above method of the present invention will be described hereinafter with reference to 
elements of a lane drifting warning system. 

[0018] A CCD camera is mounted at a predetermined location on the vehicle and the camera is connected to an 
electronic control unit (ECU), the ECU having a predetermined program installed therein. When the vehicle is operated, 
the camera collects images of lane markers and outputs corresponding image signals to the ECU, thereby performing 

*s step S20 in which image signals are input to the ECU. 

[0019] Next, step S21 is performed in which noise is removed from the image signals using a median filter After this 
operation, step S22 is performed in which the image signals are divided into multiple resolutions, thereby enabling the 
image signals to be quickly processed. That is, the number of pixels in the image signals input into the ECU is reduced 
in the same, and the pixels are divided to have different multiple resolutions. 

so [0020] Following the above, the ECU performs step S23 and extracts lane marker edges from the lane marker image 
signals which are divided having different resolutions. Next, the ECU conducts step S24 in which road modeling is 
performed. In more detail, with reference to FIG. 4, a minimum number of possible markings of the extracted lane 
edges arc input in step S40. Next, performing step S41 , a linear function having a minimum deviation is obtained from 
the possible markings of the lane edges by using the least squares method. Finally, in step S42, lines defining the lane 

55 markings are obtained using the linear function in step S42, thereby completing the road modeling process. The fol- 
lowing outlines the development of equations to perform this operation. 
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y(x) = a + bxa, b: unknown quantity 
[0021] To obtain a deviation (ri) of each point in equation (1 ), 

ri = yi - y(x) = yi - (a + bx), i = 1 , 2, 3, iL: total number of measured coordinates 
[0022] A total (R) of the squares of deviations 



R = £ (ri) 2 = r (yi - a - bxi) 2 



a value to minimize the value of R is obtained 
75 [0023] The differentiation of R with respect to a and b is set to 0. 



differentiation (R/a) = -2 Z (yi - a - bxi) = 0 
differentiation (R/b) = -2 (xi - a - bxi) = 0 

[0024] If equation (4) is written matrix form: 



(A(1,1) A(1,2) ( A(2,1) A(2,2)) (a,b) = (Z1.22) 



with: 



A(1,1)=L 
A(1,1) = Zxi 
21 = Xyi 
A(1,1) = Ixi 
A(1,1) = I(xi) 2 
Z1 = T xi yi 
a and b are: 



0) 



(2) 



(3) 



(4) 



(5) 



40 



45 



50 



55 



a = [A(2,2)Z1- A(1,2)Z2]/d 
b = [A( 1 , 1 )A(2,2)- A( 1 ,2)A(2, 1 )] / d 

d = A(1 , 1 ) A(1 ,2) - A(1 ,2) A(2 ( 1 ): determined 
[0025] An outline of measured lane marker points is as follows: 

Table 1 



i 


X 


V 


1 


0.1 


0.61 


2 


0.4 


0.92 


3 


0.5 


0.99 


4 


0.7 


1.52 


5 


0.7 


1.47 


6 


0.9 


2.03 



(6) 
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[0026] As shown by the measured values in Table 1 , also appearing in FIG. 5, even though possible lane markings 
(i) 2 and 3 are obvious errors resulting from noise, the straight line made following the flow of possible lane markings 
(i) 1 ,4,5 and 6 compensates for these errors. 

[0027] After the ECU has performed the process of road modeling of step S24 as in the above, the ECU performs 
step S25 and determines if the road modeling is completed. If it is determined that road modeling is not completed, 
the process returns to step S23. However, if the road modeling is completed, the ECU performs step S26 in which a 
camera parameter is obtained for fixing the camera at an initial position and calculating the actual width of the lane in 
order to extract the actual width of the lane from two-dimensional image coordinates with regard to the image signals 
input from the CCD camera. After the camera parameter is obtained, the actual width of the lane, in the road modeled 
as in the above, is calculated according to a distance between pixels of image coordinates. 

[0028] Following the above, the ECU performs step S27 in which it is determined if the vehicle is veering out of the 
width of the lane calculated in step S26. At this time, if it is determined by the ECU that the vehicle is not veering from 
the lane, the process returns to step S23. However, if the vehicle is drifting out of the lane in step S27, the ECU performs 
step S28 and outputs alarm-out signals to an alarm unit, which in turn outputs a warning to alert the driver. 
[0029] In the road modeling method for a lane drifting warning system of the present invention as described above, 
precise road modeling of a lane the vehicle is driving in is possible, even with the generation of errors caused by noise 
in road image signal data. 

[0030] Although preferred embodiments of the present invention have been described in detail hereinabove, it should 
be clearly understood that many variations and/or modifications of the basic inventive concepts herein taught which 
may appear to those skilled in the present art will still fall within the spirit and scope of the present invention, as defined 
in the appended claims. 



Claims 

25 

1 . A road modeling method for a lane drifting system comprising the steps of: 

extracting an edge of lane markers of a lane in which a vehicle is being driven by a camera collecting images 
of the lane markers and outputting corresponding image signals, removing noise from the lane marker image 
30 signals, and dividing the image signals into multiple resolutions; 

performing road modeling by inputting a minimum number of possible marking points of lane edges, and ex- 
tracting two straight lines most closely defining the lane by using the least squares method on the points, then 
determining if the road modeling is completed; 

calculating a width of the lane if the road modeling is completed by calculating a camera parameter according 
35 to a positioning of the camera, and by determining a distance between pixels of image coordinates; and 

determining if the vehicle is veering from the lane using information of the width of the lane, and outputting a 
warning if it is determined that the vehicle is veering from the lane. 

2. The road modeling method of claim 1 wherein the step of performing road modeling further comprises the steps of: 

40 

inputting a minimum number of the possible marking points of the extracted lane edges; 

obtaining a linear function having a minimum deviation from the possible marking points of the lane edges; and 

obtaining lines of the lane markings defining the lane using the linear function. 

45 
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FIG. 2 a 
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FIG. 4 
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